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Cloud computing has emerged to influence multimedia content providers like 
Disney to render their multimedia services. When content providers use the 
public cloud, there are chances to have pirated copies further leading to a loss 
in revenues. At the same time, technological advancements regarding content 
recording and hosting made it easy to duplicate genuine multimedia objects. 


This problem has increased with increased usage of a cloud platform for 


rendering multimedia content to users across the globe. Therefore it is 
essential to have mechanisms to detect video copy, discover copyright 
infringement of multimedia content and protect the interests of genuine 
content providers. It is a challenging and computationally expensive problem 
to be addressed considering the exponential growth of multimedia content 
over the internet. In this paper, we surveyed multimedia-content protection 
mechanisms which throw light on different kinds of multimedia, multimedia 
content modification methods, and techniques to protect intellectual property 
from abuse and copyright infringement. It also focuses on challenges 
involved in protecting multimedia content and the research gaps in the area 
of cloud-based multimedia content protection. 


Keyword: 


Cloud-based multimedia 
content 

Multimedia 

Multimedia content protection 
Video copy detection 


Copyright © 2018 Institute of Advanced Engineering and Science. 
All rights reserved. 


Corresponding Author: 


Gottumukkala Hima Bindu, 

Department of Computer Science & Engineering, 

University College of Engineering & Technology, 

Acharya Nagarjuna University, Guntur, Andhra Pradesh, India. 
Email: ghimabindul9 @ gmail.com 


1. INTRODUCTION 

Watermarking techniques have been around for content protection or protection of intellectual 
property in the real world. Watermarking is a process of inserting a distinct pattern into the content of video 
which is later used for copy detection. The different aspects of watermarking and how it is useful for 
intellectual property protection on the internet is explained in [1] and digital watermarking schemes for 
multimedia content protection using different approaches such as asymmetric fingerprinting protocols, zero- 
knowledge protocols, commitment schemes, and homomorphic encryption in [2]. Interestingly matching 
techniques complement watermarking techniques. The matching techniques include motion direction, motion 
matching, ordinal intensity signature, and color histogram signature are explained in [3]. Block cipher 
algorithm used in [4] for multimedia content protection. Video fingerprinting is also used to identify videos 
uniquely. Video fingerprint is a vector which can characterize and uniquely identify a video from another 
video [5]. Full-length video fingerprinting [6] and detection of online abuse of images [7] are two important 
types of research that play a vital role in protecting intellectual properties. These two incidentally equipped 
with United State Patents. 

Concerning content-based copy detection of multimedia objects, indexing of reference signatures of 
videos or fingerprints of videos plays a vital role. The recent trends in interactive multimedia computing 
include multimedia content searching, indexing, visualization, intelligent information extraction, digital 
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management, multimedia communications, digital signal processing, image, audio and video processing, and 
multimedia content protection [8]. Multimedia content shared in online social networks (OSNs) is also 
growing rapidly. Protecting such content has issues and countermeasures as explored in [9]. Digital rights 
management is another important issue about multimedia content protection. The implementation of novel 
DRM techniques based on mobile android terminal proposed in [10] and usage of buyer-friendly 
watermarking protocols in [11] have been proposed to support the protection of copyrighted digital contents. 
The remainder of the paper is structured into different sections that provide insights on various techniques 
used for multimedia content protection. 


Table 1. Acronyms 


Acronym Description 
HDFS Hadoop Distributed File System 
CBCD Content-Based Copy Detection 
MMMV Mean of the Magnitudes of Motion Vectors 
MPMV Mean of the Phase Angles of Motion Vectors 
DRM Digital Rights Management 
LSH Locality Sensitive Hashing 
SIFT Scale Invariant Feature Transform 
OSN Online Social Network 
M2M Mobile 2 Mobile 


2. VIDEO FINGERPRINTING FOR CONTENT BASED VIDEO IDENTIFICATION 

Lee and Yoo (2008) [5] used the concept of video fingerprinting. They proposed a mechanism for 
content-based video identification using the fingerprinting concept. The overview of the system is presented 
in Figure 1. It has two important phases known as fingerprint extraction and fingerprint matching. The former 
is used to obtain a fingerprint from given multimedia object while the latter is used to compare two videos 
using their corresponding fingerprints. 
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Figure 1. Overview of video fingerprinting method 


The procedure used for fingerprint extraction is illustrated in Figure 2. First of all, the given video is 
divided into resampled frames and then converted to the greyscale frames. It is done as the grayscale 
improves the robustness of fingerprint extraction. The resized frames are then partitioned into multiple 
blocks. Afterward, for each block, the centroid of gradient orientations is computed. Then fingerprint vector 
is obtained which contains compact features of the video clip which is used to identify video uniquely. 
Fingerprint matching is an important phase in the proposed system which is responsible for extracting a 
fingerprint from query video and matches it with that of a video in the database. Their empirical results 
revealed that the fingerprint matching was able to outperform other features concerning video fingerprinting. 

Lu (2009) [12] also explored video fingerprinting for video copy detection. The Metrics used for the 
mechanism include matching efficiency, low complexity, compact, discrimination, and robustness. Different 
algorithms are explored namely spatial signatures, temporal signatures, color signatures, transform-domain 
signatures, and fingerprint matching. 
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Figure 2. Illustrates the procedure of fingerprint extraction 


3. EFFECTIVE AND SCALABLE VIDEO COPY DETECTION 

Liu et al. (2010) [13] proposed an algorithm known as content-based copy detection (CBCD) 
algorithm as shown in Figure 2. The query examples used in this system include either part of reference 
videos directly or part of reference videos embedded into other videos. As shown in Figure 3, there are two 
input query video clips. They are used to test the copy detection mechanism employed by using CBCD 
algorithm. The reference video is flipped in query example 2. Example 1 contains reference video embedded 
in some region. 

The algorithm presented in Figure 4 performs various steps to have content-based copy detection. 
When query video is given as input, content-based sampling is performed first. Then the query video is 
subjected to transformation detection and normalization. Finally, SIFT extraction is carried out, and LSH 
computation is done. These steps are also carried out with a reference video to which the query video need to 
be compared. Additionally, the LSH indexing is generated for reference video and saved it to the database for 
reuse. After LSH computation, the query video is subjected to keyframe level query, keyframe level query 
refinement; keyframe level result merges, video level result fusion, video score normalization and finally 
CBCD results are generated. 

Once the results are generated, they are used to make well-informed decisions. The detection rate 
and accuracy of the CBCD algorithm showed good performance. The algorithm is scalable as well. Tasdemir 
and Cetin (2010) [14] used motion vector based features for video copy detection. They were used for 
reliable verification of signatures about multimedia content as part of CBCD. 


Te Tere | 


Figure 3. Sample query videos (a) Query example 1(b) Query example 2 
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Figure 4. Overview of CBCD algorithm 


4. DETECTING 3-D VIDEO COPIES 

Khodabakhshi and Hefeeda (2013) [15] proposed a novel content-based copy detection, especially 
for 3-D videos. First of all the system generates visual signatures for the given 3-D videos. These signatures 
are maintained in a database. They are known as reference signatures. The query video is then compared 
against the indexed database references for copy detection. The system is proved to be computationally and 
storage-wise efficient. They named their proposed system as Spider. The high-level overview of video copy 
detection system is shown in Figure 5. 
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Figure 5. 3D video copy detection system 


The people or organizations who own multimedia content are known as content owners. Video 
hosting sites are websites where videos are hosted. For instance, YouTube is one of the hosting websites. 
Video copy detection is the process of comparing original video and pirated copy and detecting a copy of the 
video. The method uses datasets provided by Mobile3DTV, Microsoft, and YouTube. The query videos are 
further divided into three categories. Type 1 query videos or near duplicate or part of reference videos. 
Type 2 category are part of reference videos embedded into other videos. 

The type 3 videos are the videos that contain no parts of original reference videos. Precision and 
recall are used to evaluate the system. Ye et al. (2016) [16] focused on mobile to mobile (M2M) 
communication for secure multimedia content distribution. They proposed a framework for content 
distribution which is shown in Figure 6. The content protection mechanism is built into a special machine. 
The special device also provides an index of content to support faster search and identification of videos. The 
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M2M network can have content distribution capabilities in a secure environment. Delivery of multimedia 
content over the Internet is explored in [17]. 


Content 


Content Index Delivery 


Authentication 


Figure 6. Overview of secure multimedia content distribution framework 


5. CLOUD-BASED MULTIMEDIA CONTENT PROTECTION SYSTEM 

Hefeeda et al. (2015) [18] proposed a system for large-scale multimedia content protection. It was 
built for protecting different kinds of media such as music clips, songs, audio clips, images, 2-D videos and 
3-D videos. Their system can be deployed either in public or private cloud. They proposed two novel 
components such as a method for signature generation for multimedia content and a distributed matching 
engine that is used to protect multimedia objects. The system overview is presented in Figure 8. 
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Figure 8. Cloud-based multimedia content protection system 


When content owners such as Pixar or Disney hosts new multimedia content over the internet, the 
content reference registration is made by generating signatures and storing them in a distributed index 
whereby implementing object matching and query processing. When pirated copies are found over the 
internet, the query signatures are generated and matched with the signatures stored in the distributed index to 


detect violations. Wei et al. (2014) [19] proposed a scheme for security and privacy of both computations and 
storage in the cloud. 
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5.1. Signature Creation 

The system supports different kinds of media for a signature generation. In fact, it supports the 
creation of composite signature which can have one or more of the elements such as visual signature, audio 
signature, depth signature, and metadata. The following are the important steps involved in signature 
generation. 
Computing visual descriptors for images. 
Dividing each image into blocks. 
Matching visual descriptors using Euclidean distance 
Block disparity computation 
Compute signature 


Ge tO 


DE-DP= fa — Fray? Fo ne F Gir — fir) (1) 


((x; — xj) /W,)? + (Wi — ¥j)/Hb)?) (2) 
Equations (1) and (2) are used to match visual descriptors and computing block disparity. 


5.2. Distributed Matching Engine 

The distributed matching engine is made up of object matching and distributed index components. 
Multimedia objects are characterized by many features containing high dimensions. For instance, an image 
can be represented by 100-200 SIFT descriptors. In each descriptor, there might be up to 128 dimensions. 
However, this differs from each multimedia object. A matching engine is constructed that describes object 
matching logic and distributed index tree that holds signatures of multimedia objects. There are three steps 
involved in object matching. First of all query data set is partitioned. For each data point, K-nearest neighbors 
are found. Afterward, application specific object matching is carried out. The precision (3) and average 
precision (4) are used to evaluate the system by calculating the accuracy of the K-nearest neighbors for a 
point and over all the points in query set. 


VT: <=K} 


Precision @ K(p)= R 


(3) 
ye! (Precision@K(} 


Average Precision @K= ial 


(4) 
Their empirical results revealed that signature for 3-D videos showed high accuracy regarding 
precision and recall. Their system is still to be improved to support quick verification of short video segments 


and live streaming videos for content protection. Similar kind of research is made by Niharika and Sahoo 
(2016) [20] for cloud-based multimedia content protection system. 


6. SUMMARY OF MULTIMEDIA CONTENT PROTECTION METHODS 
Table 2 shows a summary of the research that provides insights into different techniques employed 
for multimedia content protection. 


Table 2. Summary of Methods for Multimedia Content Protection 


Author & Year Technique Advantages Limitations Remarks 
Hampapur, Hyun, Sequence matching Detection of copied Indexing schemes for Colour and intensity 
and Bolle (2002) techniques for copy movie clips parallel convolution based signatures are 
[3] detection are yet to be used. 

implemented. 
Lee and Yoo Novel video Performs better than Robustness against Helps in content-based 
(2008) [5] fingerprinting method existing ones. transformations is not video identification. 
yet evaluated. 
Tasdemir and Vector-based feature Feature sets represent - Mean of the Magnitudes 
Cetin (2010) [14] set for content-based video for detecting of Motion Vectors 
copy detection copy detection. (MMM V) and Mean of 
(CBCD) the Phase Angles of 


Motion Vectors 
(MPMV) are exploited. 


Metois et al. Detection technique to Characterization of - United Nations Patent 
(2011) [13] find an online abuse of images and thus 
images detection of abuse 
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Author & Year Technique Advantages Limitations Remarks 
Saraswathi & Block cipher algorithm Multimedia content - Shows better 
Venkatesulu protection with performance than DES 
(2012) [4] encryption algorithm. 


Toffe (2012) [7] 


Khodabakshi and 
Hefeeda (2013) 
[15] 

Wei et al. (2014) 
[19] 


Zhang et al. 
(2014) [10] 


Hafeeda et al. 
(2015) [18] 


Full-length video 
fingerprinting 


Novel content-based 
copy detection for 3D 
videos. 

Privacy cheating 
discouragement and 
secure computation 
auditing protocol 
Novel digital rights 
management (DRM) 
technique. 
Cloud-based 
multimedia content 
protection system with 
signature generation 


Characterizes entire 
duration of the video 


and supports near- 
duplicate detection. 
High precision and 
recall 


Supports secure 
storage and secure 


computation as well. 


Mobile multimedia 
content is protected 
using DRM. 
Supports different 


types of multimedia 


content. 


Linear program 
computation and data 
mining models are not 
yet formalized. 


Batch processing, 
support for multi-view 
plus depth videos are 
not explored. 


United Nations Patent 


3D formats of videos are 
supported. 


A testbed known as 
SecHDFS is used for the 
empirical study. 


Protection of 
copyrighted contents in a 
mobile environment. 
The distributed index 
helps in object matching 
and query processing. 


and distributed 
matching engine. 


7. CONCLUSIONS AND FUTURE WORK 

Of late multimedia content growing exponentially led to the emergence of the cloud where people in 
general and multimedia content providers can store and retrieve large volumes of multimedia content. 
Content providers who are storing multimedia content in public cloud might lose revenues when their 
legitimate content gets pirated illegally. The rationale behind this is that technological advancements in the 
computing world made the content duplication and hosting easier. Thus there is every increasing threat to 
legitimate multimedia content over the cloud. Protecting such intellectual property needs to be given 
paramount importance. Therefore it is inevitable to have a more sophisticated mechanism that can 
dynamically protect multimedia content. However, in a distributed environment it is challenging to have 
computationally intensive operations. In this paper, we make a review of the present state-of-the-art of 
methods available for multimedia-content protection. The insights of the paper also include opportunities and 
challenges in the protection of rights of legitimate users of the content. In future, we intend to propose and 
implement a sophisticated cloud-based mechanism for protecting multimedia content. 
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